Datafest 2024

Golden Pash

Summary

  • Engagement and distraction
  • Structure of the content
  • Future opportunities

Time spent on each chapter

Top and bottom students after chapter one

Spread in grades and engagement

  • Does this match with EOC data?

Distraction time by chapter

Distraction time by section

Engagement vs Distraction Time

Video Effectiveness

Videos are not highly effective in driving engagement

Chapters 11-16

  • 55% overall compared to 66% of chapters 1-10

Effective Question Types

  • Null responses for red columns
  • Question Grading
    • Choice Matrix
    • Plain Text

Poorly Done Sections

Chapters 1-10, < 45% average points

  • The Concept of Distribution

  • Shape, Center, Spread, and Weird Things

  • Exploring the Mean

  • Mathematical Notation

  • Partitioning Sums of Squares

  • The Empirical Rule

  • Sampling Distribution

Chapters 11-16

  • 45% overall compared to 55% of chapters 1-10

Heatmaps

Heatmaps

Source: https://www.nsf.gov/nsb/sei/edTool/data/college-19.html

Community colleges

External Data Source: Statista

Final recommendations: Improving on review questions

  • Add checkpoints to videos to improve engagement

  • Change marking criteria for choice matrix and plain text qns

  • Revise particular sections

  • Improve outreach to other states

  • Choosing level of difficulty for questions - student can choose a level of difficulty for these review questions depending on how confident they are.

  • Personalisation (Dynamic question bank) - the platform will draw questions with different levels of difficulty depending on how the student is doing.

Question time

Appendix

Recommendation: Increasing addressable market

Distribution of EOC across textbooks

Looking at grades throughout book

Review question performance

  • Review questions are done at the end of each chapter
  • We hypothesised that they would be done better then the non-review questions (which are when the students have only just learnt the content).

Trying to expain poor review performance

  • Do students spend less time on the later review pages trying to speed through it?